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Abstract 

Guided notes were employed in two undergraduate Psychology courses involving 71 students. The study design utilized an 
alternating treatments format to compare Traditional Lectures with Guided Notes lectures. In one of the two courses, tests were 
administered after each class lecture, whereas the same type of test was administered at the beginning of the next week's 
class for the second course. Regardless of test delay, the Guided Notes condition was associated with substantially higher 
average test performance in all courses (approximately a grade level or more). Specific implications of the present applications 
and outcomes as well as future research needs are discussed. 
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P edagogy has been a focus of behavioral research and discus¬ 
sion for decades (Engleman & Carnine, 1982; Keller, 1968; 
Lindsely, 1996; Skinner, 1968). The focus of behavioral 
teaching strategies is to deem student deficits as a problem of the 
teaching environment, rather than a shortcoming of the student. 
An environmental factor of considerable interest in behavioral 
teaching strategies is active student responding (Austin, 2000; 
Barbetta & Heward, 1993; Heward, 1994; Kellum, Carr, & Dozi¬ 
er, 2001; Malanga & Sweeney, 2008). Active student responding 
involves teaching strategies that increase the probability students 
will attend to relevant information. 

One such form of active student responding, guided notes 
(Heward, 1994) presents a behavioral methodology that at¬ 
tempts to directly impact student attending with respect to vari¬ 
ables that maximize learning in note taking situations. It also can 
be incorporated easily into typical lecture approaches to teach¬ 
ing without too much response effort on the part of the instruc¬ 
tor. Using guided notes involves providing students with the in¬ 
structor’s lecture notes that contain blank spaces where students 
are instructed to fill in key concepts as didactic instruction pro¬ 
ceeds. This strategy combines both active attending on the part 
of the student, with an inclusion of discriminative stimuli that 
signal a particular response is needed. 

Guided notes were originally introduced for students with 
learning problems and were based on the notion that students 
who take good notes and attend to them later will perform bet¬ 
ter on tests than students who only read the material, or attend 
lecture during didactic instruction (Baker & Lombardi, 1985; 
Norton & Hartley, 1986). Subsequent research has demonstrated 

Correspondence concerning this paper should be sent to Timothy Weil, Ph.D., BCBA, 
Applied Behavior Analysis Program, 13301 Bruce B Downs Blvd, MHC 2115A, Tam¬ 
pa, F! 33612, email: tweil@usf.edu, phone: 813.974.2408 


the effectiveness of this approach in school classrooms (Austin, 
Lee, Thiebealt, Carr, & Bailey, 2002; Courson, 1989; Pados, 1989; 
Heward, 1994; Lazarus, 1996). It is interesting that little research 
on guided notes has occurred in university teaching settings 
where didactic instruction is a primary method for the delivery 
of information. The use of guided notes in university classroom 
settings has been reported for increasing classroom responding 
(Austin, et al., 2002), and the effects of long versus short form 
Guided Notes on recall and student satisfaction (Austin & Sas- 
son, 2001). However, not all results show significant differences 
in subsequent quiz performance when guided notes are used 
(Neef, McCord, & Perreri, 2006). Despite variable outcomes, in 
a review of behavioral approaches to university teaching Austin 
(2000) described guided notes as an advantageous practice that 
has been generally shown to increase acquisition of important 
lecture based information and represents a methodology appli¬ 
cable to current lecture based practice. 

Konrad, Joseph, & Eveleigh (2009) conducted a meta-analysis 
of the guided notes literature finding that eight studies met cri¬ 
teria for, at minimum, a comparison of a guided notes condition 
and a traditional, didactic lecture condition. Many factors were 
considered in this review, however, of particular interest was an 
analysis of the percentage of non-overlapping data points (PND) 
between condition. In these studies, PND was reported to range 
from 10%-100% overall (a lesser percentage of PND represents 
a greater difference between outcome scores); with a mean of 
52.95%. Addition of a review component before taking a quiz 
was shown to decrease the gap in outcomes between condi¬ 
tions further. The present study sought to evaluate the relative 
effectiveness of guided notes as compared to traditional didac¬ 
tic lecture (Traditional Lecture) in two university classes with a 
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comparison of test performance in both immediate and delayed 
testing conditions. 

■ METHOD 

PARTICIPANTS AND SETTING 

Undergraduate students (71) attending a large Western univer¬ 
sity participated in this study. Students were enrolled in one of 
two undergraduate psychology courses that met twice a week 
(Tuesday and Thursday). Class 1 had an enrollment of 35 stu¬ 
dents, and Class 2 had an enrollment of 36 students. Both class¬ 
es followed the same class sequence/structure with the excep¬ 
tion of when the quiz was administered. Upon starting class, the 
instructors would pull up the presentation on a large screen at 
the front of the class, ask if there were any questions or clarifica¬ 
tions needed regarding prior material, answer those questions, 
and then initiate the lecture for the day. All quizzes were scored 
by the second author immediately following the administration 
of each quiz. This format lasted throughout the semester. The 
first author was the instructor for Class 1 and the third author 
was the instructor for Class 2. 

MATERIALS 

Throughout the semester each class consisted of a traditional 
style lecture delivered by the instructor and a quiz on the mate¬ 
rial delivered either at the end of the class (Class 1), or with a 
delay till the start of the next class (Class 2). To ensure consis¬ 
tency, lectures were standardized across all topics both within 
and between the courses. That is, material for each lecture in 
each course was reviewed to ensure consistency in the number 
and type of missing content. In addition, the material for each 
course was compared to ensure similar content, difficulty, and 
that the amount of material omitted was consistent. This was 
accomplished by identifying background and relevant informa¬ 
tion from each chapter in a given courses assigned text in out¬ 
line format. All lectures, regardless of condition, were delivered 
via PowerPoint* presentation from the front of the classroom 
with the only difference being the inclusion of printed hand¬ 
outs during the Guided Notes condition (describe below) which 
consisted of the same material present on the instructor’s Pow¬ 
erPoint* slides. 

During the Guided Notes condition, students were provided 
with the full outline handout that omitted pertinent words or 
phrases that matched omitted text in the instructor’s slide pre¬ 
sentation. For example: 

Positive reinforcement is the_of a stimulus_behav¬ 
ior that results in an_in future probability of that behavior 

in similar contexts. 

Negative reinforcement is the_of a stimulus_be¬ 
havior that results in an_in future probability of that be¬ 

havior in similar contexts. 

The instructor’s slides would first show the same information 
omitted as the hand out notes until the class was called upon 
to actively provide the relevant information. During these in¬ 
stances, the class would be provided with a few seconds (10 s or 
less) to provide a response. Only individual students were per¬ 
mitted to respond (not the group). After a student responded, 
the correct information would appear on the screen regardless 


of whether the student responded correctly or incorrectly. That 
is, if a student responded correctly, the omitted material would 
appear on the screen in place of the blank. If the student re¬ 
sponded incorrectly, the instructor would not call on another 
student, and the omitted material would appear on the screen 
in place of the blank. In either situation, the instructor would 
repeat the complete correct phrase after the omitted material 
appeared In addition, space was provided on the handouts for 
additional notes to be taken on the right-hand side by students. 

DEPENDENT MEASURES 

The dependent measure in this study was class quiz average 
across two conditions (Guided Notes & Traditional Lecture). 
The quiz average was computed by summing all student scores 
and dividing by the total number of students. Averages are re¬ 
ported to two decimal places. 

INTER-OBSERVER AGREEMENT 

A second reviewer examined 100% of quiz scores from ScanT- 
ron* forms as well as the grading of the short answer for each 
quiz across both conditions and both classes. Agreement was 
calculated by summing agreements for each ScanTron* score 
and short answer by quiz and dividing by the number of agree¬ 
ments and disagreements on scores. This score was then mul¬ 
tiplied by 100 to compute a total percentage. Agreement was 
100% for both conditions across both classes. 

DESIGN 

Effects of Traditional Lecture and Guided Notes were evaluated 
through outcome scores on quizzes that were administered at 
the end of the lecture (Class 1) or at the start of the following 
class (Class 2). The design utilized was an alternating treatments 
design (Barlow & Hayes, 1979). It was decided at the beginning 
of the study to start each class as a Traditional Lecture condition 
and to then randomly alternate between conditions by flipping a 
quarter prior to any class meeting. In addition a rule on alterna¬ 
tion was included to ensure that there was never more than two 
successive presentations of either condition. In the case where a 
condition occurred twice in a row, it was decided that the next 
class meeting would occur under the other condition. Aggre¬ 
gates of the scores by all students were used to evaluate group 
performance throughout each condition. All quizzes consisted 
of 15 multiple choice, 5 true-false, and 1 short answer questions. 

In Class 1, the quiz was delivered during the last 20 min. of 
the class in which the information was presented and the stu¬ 
dents were given an opportunity to review their notes for a total 
of 5 minutes before the quiz was administered. Class 2 quizzes 
were structured the same, with the exception that the quiz was 
delivered at the start of the following class period. This allowed 
for either a two-day or four-day period of time between the pre¬ 
sentation of the material and the quiz each week. At the end of 
each class in Class 2, students were reminded to utilize the time 
between classes to study (however, the extent to which students 
studied between classes was not assessed). 

■ RESULTS AND DISCUSSION_ 

Figures 1 and 2 show outcome scores on quizzes in Class 1 and 
Class 2, respectively. As can be seen for Class 1, there was an 
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QUIZZES 

Figure 1. Data representing the average outcome scores for quizzes in each condition for Class 1 


initial increasing trend in quiz scores for both teaching methods 
with an eventual gradual decrease over the semester. However, 
the Guided Notes condition resulted in higher quiz scores for 
students throughout the semester. Variability within condition 
was modest (4.28 points in the Guided Notes condition, and 
5.07 points in the Traditional Lecture condition) with variabil¬ 
ity between conditions of 2.13 point advantage in the Guided 
Notes condition overall. As each point equates to 4% on a 100% 
scale, this computes to a grade differential of 8.52%, on average, 
throughout the semester. This results in nearly a grade level dif¬ 
ference for students in Class 1 in the Guided Notes condition. 

For Class 2, there was a mostly flat trend for both conditions 
with a slight decrease at the end of the semester for the Tradi¬ 
tional Lecture condition. Variability within condition was about 
the same as that seen in Class 1 for the Guided Notes condition 
(4.11 points) but less so in the Traditional Lecture condition 
(2.57), with variability across conditions of 2.04 points. As dis¬ 
cussed with Class 1, this results in nearly a full grade advantage 


in the Guided Notes condition (8.16%). Overall, the differentia¬ 
tion of quiz scores for this class is less evident than that seen in 
Class 1 (fig 1); however, there is a clear association between the 
guided notes format and higher quiz scores. Figure 2 represents 
a replication of Class 1 with the difference that quizzes were 
taken at least two days later. 

This research provides convincing data on guided notes being 
associated with higher quiz scores due to its alternating treat¬ 
ments applications in two classes. Interestingly, there appeared 
to be an effect on overall quiz score (Class 2) when a two day 
delay was involved prior to testing. That is, overall quiz scores, 
regardless of condition, were much lower than in Class 1 where 
the delay to test was approximately 5 minutes. One might sug¬ 
gest that the two day delay would result in additional time being 
devoted to studying the content for the quiz; however, it appears 
there was little to no review of the material before the quiz was 
administered at the start of the following class. One possible ex¬ 
planation is that having the instructors’ notes complete with the 



QUIZZES 

Figure 2. Data representing the average outcome scores for quizzes in each condition for class 2. 
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missing material may have provided the students with a false 
sense of security. This may be the case in that less studying was 
required as they did not have to pick through all lecture mate¬ 
rial. If students studied only the material containing omissions, 
much of the overall lecture material would have been ignored. 
Regardless, the Guided Notes condition consistently resulted in 
higher quiz scores than the Traditional Lecture condition, when 
a delay was imposed. It would seem that further study is neces¬ 
sary to better understand the possible benefits from attending 
to material as required in guided notes and delay in testing for 
that material. 

These data provide support for the use of guided notes in Uni¬ 
versity classroom lecture courses such that more effective deliv¬ 
ery of the focal points of lecture may be made. The significance 
of the effects of guided notes is more obvious when looking at 
students overall grades for the semester. That is, guided notes 
were associated with quiz score differences on the order of a full 
grade point. They extend the finding reported by Austin (2002) 
as well as previous research. Unfortunately, in research of this 
nature, there are a variety of confounding variables to be dealt 
with that would appear out of the realm of possible control. 
Idiosyncratic variables such as study habits, past college level 
performance, and competing study needs are difficult to con¬ 
trol for. Additionally, possible causal variables such as attention, 
amount and type of information represented by guided note 
blanks (Austin & Sasson, 2001), rule formation, time to test and 
type of test, as well as their possible interactive effects, will need 
clarification in future research. 

When visually analyzing the data, it appears there is an over¬ 
all decreasing trend for both conditions in Class 1 and an overall 
decreasing trend for Traditional Lecture in Class 2. This may be 
a function of material becoming more difficult over the course 
of the semester as an artifact of the material being cumulative. If 
this were the case, however, it would be expected that the perfor¬ 
mance in Guided Notes condition in Class 2 would have shown 
a greater decrease than observed. Instead, the course permitted 
dropping of one quiz grade in the semester. It is assumed that 
the decreases observed in the final weeks of the semester was 
primarily due to students’ deciding to drop one of the final quiz¬ 
zes. If a small percentage of students did not study for one of the 
final quizzes, the overall average would drop considerably and 
result in lower aggregate quiz scores. 

This begs the question of whether aggregate quiz scores are 
acceptable as a meaningful unit of analysis for reporting on 
guided notes research. Another option, taken from behavior an¬ 
alytic method, would seem to suggest that it is sensible to con¬ 
duct an individual performer analysis wherein it may be pos¬ 
sible to ascertain changes in individual performance between 
Traditional Lecture and Guided Notes conditions. Data could 
then be reported on the proportion of students who perform at 
a particular level change in a Guided Notes condition quiz ver¬ 
sus the most recent Traditional Lecture condition quizzes com¬ 
puted as a moving average. For instance, while arbitrarily set, a 
change score of a half letter grade over the moving average for 
Traditional Lecture quizzes for that student could be identified 
as an instance of improvement as a result of the Guided Notes 
intervention. In computing this for each student, it would be 


possible to report a percentage of students who performed at a 
half letter grade better in the Guided Notes condition. 

Finally, while infrequent, it is interesting to note that several 
students individually performed better in the Traditional Lec¬ 
ture condition without the added guided notes. It is not clear 
why this effect would be observed, however, it can be surmised 
that a history of effective attending and note-taking by some 
students could be undermined by the relative simplicity of guid¬ 
ed notes. In fact, it may be possible that the use of guided notes 
could actually lead to less attending of other material and thus, 
less focus on larger bodies of information. That is, the omission 
of words or small segments of larger pieces of information may 
lead a student to merely focus on those smaller parts. As a re¬ 
sult, the student may be inclined to ignore the rest of the passage 
leading to a lack of context surrounding the words or phrases 
that are omitted. 

This is, of course, only one of many possibilities and lends 
credence to further study of the interactional effects of speaker 
and listener in the context of lecture-based classes at the under¬ 
graduate level. Another possible off-shoot of the active learner 
concept is the analysis of distance learning materials centered 
on the use of guided notes technology in a train and test format. 
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